Skip to content

Split Actor logs in their own files #495

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

pablorfb-meta
Copy link
Contributor

Summary:

  • Each actor type will create a new file suffixed with the actor name
  • Each log will contain the proc and rank id of the actor. This will simplify filtering to logs of a single actor
  • Logs not coming from an actor will be dumped in a common file suffixed 'monarch'

TODO:

  • Support Python Actors
  • Support multiple configurable streams for Local

Differential Revision: D78101221

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 10, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 11, 2025
Summary:

- Each actor type will create a new file suffixed with the actor name
- Each log will contain the proc and rank id of the actor. This will simplify filtering to logs of a single actor
- Logs not coming from an actor will be dumped in a common file suffixed 'monarch'
- Additionally stream all logs to stdout when `MONARCH_STDOUT=1`

TODO:
- Support Python Actors

Differential Revision: D78101221
pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 11, 2025
Summary:

- Each actor type will create a new file suffixed with the actor name
- Each log will contain the proc and rank id of the actor. This will simplify filtering to logs of a single actor
- Logs not coming from an actor will be dumped in a common file suffixed 'monarch'
- Additionally stream all logs to stdout when `MONARCH_STDOUT=1`

TODO:
- Support Python Actors

Differential Revision: D78101221
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 11, 2025
Summary:
Pull Request resolved: pytorch-labs#495

- Each actor type will create a new file suffixed with the actor name
- Each log will contain the proc and rank id of the actor. This will simplify filtering to logs of a single actor
- Logs not coming from an actor will be dumped in a common file suffixed 'monarch'
- Additionally stream all logs to stdout when `MONARCH_STDOUT=1`

TODO:
- Support Python Actors

Differential Revision: D78101221
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 11, 2025
Summary:
Pull Request resolved: pytorch-labs#495

- Each actor type will create a new file suffixed with the actor name
- Each log will contain the proc and rank id of the actor. This will simplify filtering to logs of a single actor
- Logs not coming from an actor will be dumped in a common file suffixed 'monarch'
- Additionally stream all logs to stdout when `MONARCH_STDOUT=1`

TODO:
- Support Python Actors

Differential Revision: D78101221
@pablorfb-meta pablorfb-meta force-pushed the export-D78101221 branch 2 times, most recently from fdd3ad3 to 8d942e7 Compare July 13, 2025 15:35
pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:
Pull Request resolved: pytorch-labs#495

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:
Pull Request resolved: pytorch-labs#495

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
pablorfb-meta added a commit to pablorfb-meta/monarch that referenced this pull request Jul 13, 2025
Summary:
Pull Request resolved: pytorch-labs#495

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

Summary:
Pull Request resolved: pytorch-labs#495

- Add per proc suffix to file logger
- Gate STDERR logging with flag

Differential Revision: D78101221
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78101221

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants